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ABSTRACT 

The research reported in this paper deals with the problem of searching 
through an unknown terrain by a physical agent such as a robot. The un- 
known terrain over which the agent will travel is represented by an 
undirected graph. The agent has no prior knowledge of the graph. It can 
only learn about its environment by physically roaming it. Given a starting 
locarion s, the agent tries to reach a target location t using the minimum 
amount of physical movement. This problem, which is a natural generaliza- 
tion of the classical shortest path problem, will be referred to as the dynamic 
shortest path problem. Most of the classical shonest path algorithms per- 
form very poorly in the scenario of a physical agent traversing an initially 
unknown search space. They do not attempt to minimize the amount of 
physical movement required by the agent to reach the goal location. In 
order to overcome the failings of these search algorithms in dealing with 
searches of this particular nature, a new search strategy, called persistence 
search, is developed and presented in this paper. 
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1. INTRODUCTION 

One of the central problem-solving techniques in AI is the use of search. In this paper, 
we focus our attention on the problem of searching through an unknown terrain by a physical 
agent such as a robot. The unknown terrain over which the agent will travel is represented by 
an undirected graph. The agent has no prior knowledge of the graph. It can only learn about 
its environment by moving through it. Starting at a given vertex s , the agent tries to reach a 
target vertex t using the minimum amount of physical movement. This problem, which is a 
natural generalization of the classical shortest path problem, will be referred to as the dynamic 
shortest path problem. If the agent has prior knowledge of the entire graph, it can minimize 
its physical movement by first computing the shortest path from s to r using the standard 
shortest path algorithms and then moving towards t along the shortest path. (See for exam- 
ple, [2] and [3] for a survey of the shortest path algorithms.) Without complete information 
of the entire graph, no optimum algorithm (i.e. one that always produces the shortest path 
from 5 to r in any given graph) can exist. The reason is because, without prior knowledge of 
the entire graph, the agent must physically roam its environment, learning about it by sensing 
the immediate surroundings. A state of any state-space search algorithm now depends on 
both the current physical location of the agent and the total amount of physical movement that 
has been made already. Since the energy or time involved in physical movement cannot be 
recovered once expended, any optimum algorithm must require the agent to traverse along the 
shortest path from 5 to t at all times. This is impossible since the algorithm does not have 
any prior knowledge of the graph to start with. Hence, any algorithm for solving the dynamic 
shortest path problem is a heuristic algorithm. Such algorithm is considered to be "good" if it 
produces paths which are not much longer than the shortest paths most of the time. 

Most of the classical shortest path algorithms perform very poorly in the scenario of a 
physical agent traversing an initially unknown terrain. They do not attempt to minimize the 
amount of physical movement required by the agent to reach a desired goal location. These 
algorithms ignore the physical aspects of search, measuring the quality of their solutions only 
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by the amount of computation required. In order to overcome the failings of these search 
algorithms in dealing with searches of this particular nature, new search strategies and new 
measures for evaluating such strategies are needed. 

One measure for comparing the performance of the algorithms for dynamic problems is 
the ratio 

^ _ the total distance traversed by the agent 
the length of the shortest path from 5 to / 

In [4], Papdimitriou and Yannakakis studied several versions of the dynamic shortest 
path problem. They have devised search strategies that optimize the ratio R for two special 
cases: layered graph with bounded width and two-dimensional scenes with unit square obsta- 
cles. They further showed that no bounded ratio is possible for slightly more general graphs 
and scenes, and the computational problem of devising optimal search strategies for the 
dynamic shortest path is PSPACE-Complete. Hence, a new heuristic search strategy, called 
persistence search, is developed and presented in this paper to tackle the dynamic shortest 
path problem for general graphs. 

2. PERSISTENCE SEARCH 

As stated in the previous section, the agent begins with no knowledge of the graph. It 
can learn about the graph by moving from vertex to vertex via the edges incident to the ver- 
tices, and it can remember the vertices and edges which it has explored by dropping markers 
along the way [1]. At each vertex v, the agent has the ability to discover all the edges 
incident to the vertex v . Additionally, for each unexplored edge incident to v , the agent has 
some estimation of the distance from the vertex v to the target vertex t via the unexplored 
edge. Starting at the vertex s, persistence search directs the agent towards the destination ver- 
tex t as follows: 



Algorithm I 
Begin 
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(1 ) EXIT := FALSE. 

(2 ) c := s ; /* c denotes the current position of the agent */ 

(3 ) L := empty; /* L denotes the set of edges to be explored, called frontier edges */ 

(4 ) Repeat 

(5 ) Mark c as explored. 

(6 ) If c = r 

(7 ) Then EXIT := TRUE /* search has succeeded */ 

(8 ) Else Begin 

(9 ) For each unexplored edge (c , w ) do 

(10) Begin 

(11) If IV is explored Then mark the edge (c,w) as explored 

(12) Else add the edge (c,w) to the set L. 

(13) End. 

(14) If L is not empty 

(15) Then Begin 

(16) Among the frontier edges in L, find the frontier edge e that minimizes 

the equation 

/(e) = pf X g(v) + /i(e) , (1) 

where v is the explored vertex adjacent to e, g(v) is the shortest 
distance from c to v using only edges in the explored subgraph, 
h{e) is the estimated future cost of e , which is the lower bound 
estimate for the distance from v to t via the unexplored edge e , 
and pf is the persistence factor, a real number between 0.0 
and 1.0 for discounting the cost of "backtracking" to the frontier 
edge e. 



(17) 
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Move the agent from c to v along the shortest path using only edges 
in the explored subgraph. 

(18) Mark the edge e explored. 

(19) Let tv be the vertex at the other end of e . Move the agent along e low. 

(20) c := w; 

(21) End 

(22) Else EXIT := TRUE /* search has failed */ 

(23) End 

(24) Until EXIT; 

End. 

While the above algorithm is very close to the algorithm for A* search [5], one should 
note the subtle but important differences. The function g(v) is computed from the current 
vertex c to v, rather than from the initial starting vertex s. This is a logical choice for g(v) 
since the agent must be moved physically from the current position c to the vertex v before it 
can resume its exploration from v . 

A second difference is in the use of the persistence factor pf to bias the cost function 
g(v). The persistence factor varies between 0.0 and 1.0 and serves to discount the cost of 
"backtracking" versus estimated future cost, h{e). By varying the persistence factor, the 
behavior of the persistence search can be dramatically altered. When the persistence factor is 
0, the cost of "backtracking" from one vertex to another becomes zero and the formula for 
rating the frontier edges reduces to: 

/(e) = /t(e) (2) 

which is equivalent to that used for best-first search [5]. Each frontier edge is ranked only 
according to its estimated future cost. The agent will move about the explored search space 
without regard for the amount of physical movement required, traversing to whichever vertex 
is closest to goal. 
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When the persistence factor is equal to 1, persistence search behaves more like hiU- 
climbing search [5]. Since the cost of moving from the current vertex to another vertex in 
the explored subgraph becomes more expensive, the agent tends to be more persistent in con- 
tinuing the exploration from a vertex nearer to the present location. 

3. SEARCHING THROUGH A RECTILINEAR MAZE 

As an initial step in evaluating the performance of the proposed algorithm, persistence 
search is used to tackle a restricted version of the dynamic shortest problem; the case of an 
agent traversing a random rectilinear maze. 

The unknown terrain over which the agent will travel is represented by a rectilinear 
graph or grid-graph as shown in Figure 1. 




(a) a rectilinear maze (b) the corresponding grid-graph 

Figure 1 

Vertices are arranged in a rectangular fashion with edges connecting vertices immedi- 
ately above, below, right and left (north, south, east and west respectively), and the vertices 
are distinguished from one another by their X and Y coordinates. Locations within the maze 
are either passable or impassable. Impassable locations in the maze are represented by 
disconnected vertices in the graph, making them unreachable from any direction. 
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The agent begins with no knowledge of the graph. It can learn about the graph only as 
it moves from vertex to vertex via the edges connecting them. The agent’s ability to sense its 
surroundings is limited to determining whether the immediate neighbors of the current vertex 
are passable or impassable. Since the terrain is a grid-graph, the agent is only able to move 
and survey in the four cardinal directions. 

Additionally, the agent knows its position relative to the goal. Several different means 
could be used to accomplish this. If the agent initially knows the goal’s position relative to 
its own, it can maintain this knowledge through dead reckoning as it moves about the maze 
from its initial starting point. Using this information, the agent can determine the rectilinear 
distances from the goal to its current location as well as to any of the passable locations adja- 
cent to its current location. Rectilinear distance is a lower bound for the number of steps 
necessary to move from the current position to the goal. The rectilinear distance from a ver- 
tex V to the goal t can be computed using the formula 

\X^ -X,\ + IK, - y, I 

where (X, , K, ) and (X , , K, ) are the coordinates of v and t respectively. 

We can also direct the agent to the goal using either an active guidance system like radar 
or a passive guidance system like a beaconing system. While only lines of bearing are 
required to choose which immediate neighbor is closer to the goal, the goal’s exact location is 
needed to totally order the search space. If the goal is northeast of the current location, then 
the immediate neighbors to the north and the east are closer to the goal and have the same 
rectilinear distance to the goal. However, when comparing widely separated locations, a rank- 
ing for the locations based on their closeness to the goal cannot be determined without the 
exact location of the goal. If location P is north of the goal and location Q is south of the 
goal, there is no static way to tell which one is closer merely by their relative direction to the 
goal. However, by triangulating lines of bearing taken from different locations, the exact 
location of the goal can be determined. 
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Since the edges in the grid-graph all have equal length, we can assume that the agent 
always knows the cost of traversing an unexplored edge. Hence, instead of keeping track of a 
set of frontier edges, we can simplify the implementation of the algorithm by keeping track of 
the set of unexplored vertices that are adjacent to the frontier edges. The algorithm for 
searching through an unknown rectilinear maze is as follows: 

Algorithm n 
Begin 
(1 ) 

(2 ) 

(3 ) 

(4 ) 

(5 ) 

(6 ) 

(7 ) 

(8 ) 

(9 ) 

( 10 ) 

( 11 ) 

( 12 ) 

( 13 ) 

minimizes the equation 

/(v) = pf X g(v) + h(v) , (3) 

where g(v) is the shortest distance from c to v using only 
paths with explored venices as intermediate venices, h(v) = 

- X, I + - Y, I, and pf is the persistence factor 

with value between 0.0 and 1.0. 



EXIT := FALSE; 

c := 5; /* c denotes the current position of the agent */ 

L := {5 ); /* L denotes the set of vertices to be explored, called frontier vertices */ 

Repeat 

Remove c from L . 

Mark the vertex c explored. 

If c = r 

Then EXIT := TRUE /* search has succeeded */ 

Else Begin 

L := L { the set of unexplored immediate neighbors of c }. 

If L is not empty 
Then Begin 

Among the frontier vertices in L , find the frontier vertex v that 



(14) 
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Move the agent from c to v along the shortest path using only 
explored vertices as intermediate vertices. 

(15) c:=v; 

(16) End 

(17) Else EXIT := TRUE /* search has failed */ 

(18) End 

(19) Until EXIT; 

End. 

In order to reduce the computation required by persistence search, we further modify the 
algorithm as follows: 

Algorithm III 
Begin 

(1 ) EXIT := FALSE; 

(2 ) c := s; /* c denotes the current position of the agent */ 

(3 ) L := {5 }; /* L denotes the set of vertices to be explored, called frontier vertex *1 

(4 ) Repeat 

(5 ) Remove c from L . 

(6 ) Mark the vertex c explored. 

(7 ) If c = r 

(8 ) Then EXIT := TRUE /* search has succeeded */ 

(9 ) Else Begin 

(10) L := L [^ [ the set of unexplored immediate neighbors of c ). 

(11) If c has an unexplored immediate neighbor w such that /i(w) < /i(c) 

where h{w) and h(c) denote the rectilinear distances from w and c 
to the goal location t respectively 

(12) Then c := w and move the agent to the vertex w 
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(13) Else If L is not empty 

(14) Then Begin 

(15) Among the frontier vertices in L, find the frontier vertex v that 

minimizes the equation 

/(v) = p/ X g(v) + h{v) , 

where g{v) is the shortest distance from c to v using only 
paths with explored vertices as intermediate vertices, h(v) = 
IXy - X, I + I - y, I, and pf is the persistence factor 
with value between 0.0 and 1.0. 

(16) Move the agent from c to v along the shortest path using only 

explored vertices as intermediate vertices. 

(17) c := v; 

(18) End 

(19) Else EXIT := TRUE /* search has failed */ 

(20) End 

(21) Until EXIT; 

End. 



Now, the agent always moves to the immediate neighbor w of the current vertex c if 
h{w) < h{c) (lines 11-12 in Algorithm III). A simple north, east, south, west preference 
serves as a heuristic to break ties between neighbors of equal estimated future cost. This 
modification greatly reduces the computation required by the agent since it no longer has to 
examine the list of frontier vertices whenever c has an immediate neighbor with a cheaper 
future cost. Algorithm HI can be regarded as a hybrid of hill climbing search and persistence 
search. Note that when pf = \, the physical moves produced by Algorithms II and III are 
identical for all rectilinear mazes. When pf < I, Algorithms II and III only produced identi- 
cal moves for rectilinear tree mazes, i.e. mazes without circuits. 
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4. EVALUATING THE PERFORMANCE OF THE ALGORITHMS 

There are two factors governing the performance of the proposed algorithms: the compu- 
tational efficiency of the algorithms and the quality of the solutions produced. As mentioned 
in Section 1, the quality of the solution can be measure by the error ratio R , which is equal to 

the total number of edges traversed by the agent to reach the goal 
the length of the shortest path from 5 to r in the entire maze 

The computational efficiency of the algorithms can be measured by counting the total number 
of current vertices examined plus the total number of vertices examined while computing the 
shortest paths from a current vertex back to the frontier vertices via the explored subgraph. 

Given any integer n and any pf value between 0.0 and 1.0, one can always come up 
with a worst-case maze with n vertices that requires 0{n ) vertex-examinations and the solu- 
tion produced by the algorithms has an 0{n) error ratio. Figure 2 shows two worst-case 
examples, one for the pf value of 0 and the other for the pf value of 1. 





(a) a worst-case example for p/= 0.0 (b) a worst-case example for pf = 1.0 

Figure 2 

While the agent may have to visit every vertex in the graph before finding the goal in 
the worst-case, the total distance traversed by the agent may be substantially lower on the 
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average. In order to better judge the performance of the persistence search algorithms, we 
have implemented Algorithms II and III as well as a hill-climbing search algorithm in the C 
programming language and applied the algorithms to a large set of random mazes generated 
by the algorithm described in the next section. 

4.1 MAZE GENERATION 

The random maze generator operates in two modes, creating mazes with or without 
cycles. The mazes without cycles can be naturally represented as trees and those with cycles 
can be represented as graphs. We have separated the tree mazes from the nontree mazes 
because of the way persistence search backtracks. When backtracking, persistence search 
always travels to the cheapest frontier vertex (i.e. the frontier vertex with the cheapest com- 
bined cost) along the shortest path in the explored subgraph. This gives persistence search an 
extra advantage over hill-climbing search. The hill-climbing search, being a variant of depth- 
first search, does not take short-cuts and always traces back to the cheapest frontier vertex 
along the path from which it came. In non-tree mazes, this results in a large amount of back 
and forth movement by the hill-climbing search algorithm as it winds its way out of large 
open areas. This inefficient behavior can be seen clearly in Figure 3, where the hill-climbing 
search requires the agent (which at vertex 13) to visit all blank vertices before backtracking to 
vertex 14, while persistence search allows the agent to go from vertex 13 to vertex 14 via ver- 
tex s in two mechanical steps. If the maze is a tree, there are no circuits and persistence 
search no longer has such an advantage. 

The maze generation algorithm, makemaze, uses a depth-first algorithm to create a ran- 
dom path through an initially empty maze, placing obstacles at intervals along its path accord- 
ing to a parameter called maze density. Makemaze begins by laying obstacles along the boun- 
dary of the rectangular maze. It then picks a random starting point within the maze. The 
algorithm maintains a trail of the locations in the maze it has explored. 
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Figure 3 



At each step along its path, it randomly determines whether it must turn from its current 
direction. If so, it places an obstacle in the direction it was going and continues on in a ran- 
dom new direction. The higher the maze density, the more likely it is that the path will turn 
and an obstacle will be created. If the maze generator becomes "blocked" by its own trail or 
obstacles, it backtracks along its original trail until it comes to a new location and resumes its 
exploration. 

If makemaze is restricted to creating mazes which are trees, it must also check to see if 
the next location it is going to explore will create a cycle in the maze. If so, it places an obs- 
tacle there instead and chooses a new direction. Hence, there is only one path between any 

two vertices in a tree maze. 

4.2 THE HILL-CLIMBING SEARCH 

For comparison with persistence search, a hill-climbing search algorithm was imple- 
mented. We chose to compare the proposed algorithm against the hill-climbing search 

because the hill-climbing search (or some other depth-first search variant) is the only 
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reasonable alternative to persistence search in guiding a physical agent through an unknown 
bounded terrain. The other alternatives, like best-first search or some variants of A* search, 
require too much movement on the part of the physical agent, causing it to physically 
crisscross known search space to expand new vertices. 

The hill-climbing search algorithm is very similar to the algorithm used to create the 
maze, as they both are variants of the depth-first search algorithm. The hill-climbing search 
algorithm uses a simple stack to keep track of its current path and a bitmap to mark the ver- 
tices it has visited. It places the unexplored immediate neighbors of the current vertex on the 
stack according to the non-increasing order of their estimated future costs, leaving the one 
with the cheapest estimated future cost on the top of the stack. It then pops a vertex off the 
stack, updates the current vertex and moves the physical agent to the new current vertex. 

4.3 SPEEDING UP THE PERSISTENCE SEARCH 

A major portion of the computation is spent in Line 13 of Algorithm II and Line 15 of 
Algorithm III for finding the shortest-path from the current vertex to the cheapest frontier ver- 
tex in the list L. Since the edges in the grid-graph all have equal length, a simple breadth- 
first search (BPS) is used to scan the explored subgraph for the cheapest frontier vertex each 
time the list L has to be examined. In order to reduce the time required to compute these 
shortest paths, "branch-and-bound" is introduced into the breadth-first search as follows. At 
the beginning of the BPS, the lower bound for the cheapest combined cost is initialized to the 
smallest estimated future cost of all the frontier vertices in L and the upper bound for the 
cheapest combined cost is initialized to positive infinity (or some very large positive number). 
During the course of the search, the upper bound for the cheapest combined cost is set to the 
lowest combined cost of the frontier vertices visited so far while the lower bound for the 
cheapest combined cost is set to the sum of the current depth reached by BPS plus the 
cheapest estimated future cost among all frontier vertices in L . To keep track of the smallest 
estimated future cost among all the frontier vertices in L , the vertices in L are maintained in 
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the form of a min-heap, with the frontier vertex which has the smallest estimated future cost 
on top. The min-heap is updated whenever vertices are added to or deleted from L. The 
search terminates when the lower bound is greater than or equal to the upper bound, thus sig- 
naling that the frontier vertex with the lowest combined cost has been found. The agent can 
then traverse from the current vertex c to the frontier vertex v via the search tree constructed 
by BPS. 

4.4 THE EXPERIMENTAL RESULTS 

Two experiments were conducted to study the performance of the proposed algorithms. 
In the first experiment, a total of 8000 runs were performed and analyzed empirically. Input 
to the first experiment was generated as follows. Two thousand mazes, in groups of 50, were 
created using the algorithm described in Section 4.1. The mazes in each group were gen- 
erated based on a unique combination of maze type, maze density and dimension of the 
underlying rectangular grid. (See Table 1 for a summary of the mazes.) Two pairs of pass- 
able locations were chosen from each maze, and two experimental runs were performed for 
each of the location pair [a , b] chosen, once from a to b and once from b to a. 

The results of the first experiment are summarized in Tables 2-7. From the experimental 
results, one can conclude that persistence search (both Algorithms II and III) outperforms 
hill-climbing search for both nontree mazes and tree mazes (Tables 2a, 2b, 3a and 3b). The 
solutions produced by Algorithms II and III are equally good (Tables 4a and 4b) but Algo- 
rithm in runs much faster than Algorithm H (Tables 6a, 6b, 7a and 7b). 

For nontree mazes. Algorithm in achieves its best results when the persistence factor is 
between 0.4 and 0.6, producing solutions that are at most 1.45 times as long as the best possi- 
ble solutions for sparse nontree mazes (mazes with density < 0.5) and 6.5 times as long as the 
best possible solutions for dense nontree mazes (mazes with density = 0.9). Moreover, these 
performance ratios grow very slowly when compared to the growth rate of the sizes of the 
search space. Table 7a shows the computational overhead of Algorithm in for nontree mazes. 
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For persistence factors between 0.4 and 0.6, Algorithm III takes, on the average, between 15 
to 24 computational steps for each physical step produced, which is an acceptable trade-off 
given today’s high-speed computers. (A computational step corresponds to either a vertex 
examination or a heap operation. Each vertex examination involves marking the vertex as 
visited and adding the vertex’s unvisited neighbors to the agenda, and each heap operation 
involves comparing a node against its parent and interchanging the positions of the two 
nodes.) Table 5a shows the comparisons between the solutions produced by Algorithm III and 
hill-climbing search for nontree mazes. Algorithm IE clearly outperforms hill-climbing search 
in terms of both the frequency of producing better solutions and the average length of the 
solutions produced. 

For tree mazes. Algorithm III achieves its best results when the persistence factor is 
between 0.2 and 0.4. Although the paths for tree mazes produced by Algorithm III are on the 
average shorter than those produced by hill-climbing search (Table 3b), Algorithm IE only 
produces better solutions 30% percent of the time (Table 5b). This discrepancy is due to the 
anomalous behavior of the hill-climbing search. Hill-climbing search actually produces paths 
that are shorter than the corresponding average path lengths R^^ over 75% of the time. Unfor- 
tunately, there are always five to ten runs in each maze group that cause hill-climbing search 
to produce paths that are fifty to a hundred times longer than the average lengths. Persistence 
search, on the other hand, always produces paths with lengths distributed uniformly around 
the corresponding average path lengths R/u. Hence, persistence search should be used if one 
wants a good worst-case performance at the expense of longer computational time — Algo- 
rithm IE, with persistence factors between 0.2 and 0.4, takes on the average as high as 85 
computational steps for each physical step produced. 

In order to better understand how persistence factor affects the performance of per- 
sistence search for nontree mazes, another 7000 runs were performed and analyzed empiri- 
cally. (See Table 8 for a summary of the input data.) The results of the second experiment 
are summarized in Tables 9-11. For all the nontree mazes tested. Algorithm III seems to 
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perform equally well with different persistence factors between 0.4 and 0.6. More important, 
the performance ratios remain fairly constant with respect to the increasing sizes of the search 
space. Hence, one can conclude from the experimental results that persistence search with 
persistence factor between 0.4 and 0.6 is indeed a very good heuristic algorithm for searching 
through unknown nontree mazes. 

5. CONCLUSIONS 

In this paper, a new search strategy is proposed to minimize the total distance traversed 
by an agent in search of the target location. In light of our experimental results, persistence 
search is a very good strategy for searching unknown nontree mazes. The success of per- 
sistence search comes from its ability to cut across its own path to take advantage of the short 
circuits in the terrain, as well as the use of the persistence factor to discount the cost of aban- 
doning the current location in order to continue the exploration somewhere else. This is par- 
ticularly useful in exploring unknown unbounded mazes. Persistence search (with persistence 
factor less than one) always finds the goal as long as it is reachable from the starting location, 
while hill-climbing search may make a wrong turn and miss the goal forever. Persistence 
search is the preferred strategy for searching tree mazes if one wants to minimize the worst- 
case path length. One way to improve the computational efficiency of persistence search for 
tree mazes is to modify persistence search so that it behaves like hill-climbing search most of 
the time and only evaluates the possibility of backtracking to another frontier vertex once 
every K mechanical steps for some large constant K. 
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group 

number 


maze 

type 


number 
of mazes 


maze 

density 


grid 

dimension 


avg. number of 
passable cells 


avg. length of 
the shortest paths 


(1) 


nontree 


50 


0.1 


128 X 128 


14734.38 


84.76 


(2) 


non tree 


50 


0.1 


192 X 192 


33503.52 


120.84 


(3) 


nontree 


50 


0.1 


256 X 256 


59866.72 


167.34 


(4) 


non tree 


50 


0.1 


320 X 320 


93830.20 


215.70 


(5) 


nontree 


50 


0.3 


128 X 128 


13137.48 


90.35 


(6) 


non tree 


50 


0.3 


192 X 192 


29875.64 


142.60 


(7) 


nontree 


50 


0.3 


256 X 256 


53382.76 


175.55 


(8) 


nontree 


50 


0.3 


320 X 320 


83697.34 


218.54 


(9) 


nontree 


50 


0.5 


128 X 128 


11821.24 


89.10 


(10) 


nontree 


50 


0.5 


192 X 192 


26889.66 


138.35 


(11) 


nontree 


50 


0.5 


256 X 256 


48046.98 


176.68 


(12) 


nontree 


50 


0.5 


320 X 320 


75283.82 


240.48 


(13) 


nontree 


50 


0.7 


128 X 128 


10475.96 


106.90 


(14) 


nontree 


50 


0.7 


192 X 192 


23843.44 


162.74 


(15) 


nontree 


50 


0.7 


256 X 256 


42594.08 


205.43 


(16) 


nontree 


50 


0.7 


320 X 320 


66799.02 


249.33 


(17) 


noniree 


50 


0.9 


128 X 128 


7808.36 


177.92 


(18) 


nontree 


50 


0.9 


192 X 192 


17914.74 


226.88 


(19) 


nontree 


50 


0.9 


256 X 256 


32259.48 


300.98 


(20) 


non tree 


50 


0.9 


320 X 320 


50661.42 


384.26 


(21) 


tree 


50 


0.1 


128 X 128 


8884.88 


720.03 


(22) 


tree 


50 


0.1 


192 X 192 


20156.64 


1554.56 


(23) 


tree 


50 


0.1 


256 X 256 


35960.40 


2536.39 


(24) 


tree 


50 


0.1 


320 X 320 


56326.42 


3259.97 


(25) 


tree 


50 


0.3 


128 X 128 


9077.72 


869.04 


(26) 


tree 


50 


0.3 


192 X 192 


20608.66 


1932.15 


(27) 


tree 


50 


0.3 


256 X 256 


36778.46 


2878.34 


(28) 


tree 


50 


0.3 


320 X 320 


57575.86 


4719.78 


(29) 


tree 


50 


0.5 


128 X 128 


8890.08 


875.58 


(30) 


tree 


50 


0.5 


192 X 192 


20222.80 


1929.14 


(31) 


tree 


50 


0.5 


256 X 256 


36088.92 


2961.83 


(32) 


tree 


50 


0.5 


320 X 320 


56561.28 


3924.45 


(33) 


tree 


50 


0.7 


128 X 128 


8168.80 


745.53 


(34) 


tree 


50 


0.7 


192 X 192 


18670.30 


1573.50 


(35) 


tree 


50 


0.7 


256 X 256 


33447.74 


2526.46 


(36) 


tree 


50 


0.7 


320 X 320 


51407.10 


3821.66 


(37) 


tree 


50 


0.9 


128 X 128 


5397.86 


455.80 


(38) 


tree 


50 


0.9 


192 X 192 


12674.86 


901.80 


(39) 


tree 


50 


0.9 


256 X 256 


22907.76 


1624.02 


(40) 


tree 


50 


0.9 


320 X 320 


36279.30 


2340.57 



Table 1 : Summary of the 2000 mazes used in the first experiment 
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II 
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II 


d 

II 
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II 

P 

bo 


P 

II 


(1) 


1.105 


1.060 


1.060 


1.060 


1.060 


1.060 


1.071 


(2) 


1.080 


1.061 


1.061 


1.061 


1.061 


1.061 


1.074 


(3) 


1.101 


1.065 


1.065 


1.065 


1.065 


1.065 


1.073 


(4) 


1.116 


1.058 


1.058 


1.058 


1.058 


1.058 


1.075 


(5) 


1.748 


1.193 


1.193 


1.192 


1.195 


1.197 


1.267 


(6) 


1.715 


1.198 


1.198 


1.195 


1.197 


1.198 


1.249 


(7) 


1.432 


1.210 


1.207 


1.207 


1.210 


1.209 


1.248 


(8) 


2.351 


1.211 


1.211 


1.210 


1.211 


1.213 


1.271 


(9) 


4.710 


1.433 


1.422 


1.394 


1.415 


1.422 


1.579 


(10) 


4.940 


1.454 


1.435 


1.429 


1.446 


1.452 


1.583 


(11) 


3.948 


1.435 


1.428 


1.417 


1.425 


1.430 


1.561 


(12) 


6.434 


1.460 


1.438 


1.435 


1.434 


1.487 


1.656 


(13) 


10.725 


2.195 


2.023 


1.985 


1.958 


2.003 


2.488 


(14) 


11.492 


2.213 


1.998 


1.986 


1.971 


2.031 


2.409 


(15) 


13.249 


2.296 


2.055 


1.997 


2.013 


2.031 


2.453 


(16) 


16.514 


2.226 


2.037 


1.971 


1.976 


1.980 


2.348 


(17) 


17.403 


14.515 


6.241 


5.994 


6.089 


6.411 


7.505 


(18) 


31.105 


12.015 


5.686 


5.066 


5.511 


6.144 


8.472 


(19) 


50.371 


15.597 


6.491 


5.991 


6.469 


6.392 


8.663 


(20) 


68.756 


12.093 


5.608 


5.305 


5.216 


5.581 


7.118 



Table 2a : Summary of the results for Algorithm II on the 
nontree mazes in the first experiment 



Note: 

Rf^ “ the average value of h-moveslmin-moves over the 200 runs in each maze 
group, 

Rjj — = the average value of ll-moves ! min-moves over the 200 runs in each maze 
group, 

where 

h-moves — the total number of physical moves required by the agent to 
reach the goal under hill-climbing search, 

Il-moves — the total number of physical moves required by the agent to 
reach the goal under Algorithm II, 

min-moves — the length of the shortest path from ^ to r in the entire maze. 
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10.296 
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9.673 
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13.666 
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14.517 


14.979 


14.631 
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13.666 
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29.515 


95.562 


17.136 


16.171 


17.489 


17.251 


29.515 


(24) 


iz.m 


110.570 


19.272 


19.206 


21.156 


21.031 


23.079 


(25) 


10.059 


31.770 


10.876 


10.571 


10.583 


9.094 


10.059 


(26) 


12.543 


58.243 


12.713 


11.933 


12.484 


12.213 


12.543 


(27) 


51.699 


75.415 


13.650 


16.174 


18.977 


18.357 


51.699 


(28) 


26.052 


109.929 


16.981 


20.367 


22.071 


18.719 


26.052 


(29) 


11.863 


33.949 


9.291 


10.315 


10.824 


9.384 


11.863 


(30) 


19.964 


54.030 


11.058 


12.647 


13.566 


12.528 


19.964 


(31) 


17.367 


72.856 


15.579 


15.141 


15.927 


15.336 


17.367 


(32) 


22.518 


94.564 


16.875 


18.393 


20.809 


20.476 


22.518 


(33) 


10.069 


32.153 


9.023 


9.370 


9.044 


9.736 


10.069 


(34) 


18.723 


46.966 


12.327 


11.305 


11.729 


12.003 


18.723 


(35) 


20.672 


70.423 


13.882 


15.400 


15.399 


15.133 


20.672 


(36) 


46.383 


90.225 


14.504 


15.458 


18.954 


16.293 


46.383 


(37) 


10.989 


31.353 


7.724 


8.086 


7.298 


8.905 


10.989 


(38) 


30.009 


48.389 


10.447 


10.460 


10.028 


10.274 


30.009 


(39) 


24.401 


70.389 


13.050 


13.078 


12.920 


15.196 


24.401 


(40) 


17.953 


82.959 


13.639 


14.820 


14.251 


13.847 


17.953 



Table 2b : Summary of the results for Algorithm II on the 
tree mazes in the first experiment 
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1.065 
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1.976 


1.980 


2.348 


(17) 


17.403 


14.515 


6.242 
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6.491 
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6.394 


8.663 
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68.756 


12.093 


5.608 


5.305 


5.213 


5.581 


7.118 



Table 3a : Summary of the results for Algorithm in on the 
nontree mazes in the first experiment 



Note: 

" the average value of h-moves! min-moves over the 200 runs in each maze 
group, 

Rill — = the average value of Ill-moves ! min-moves over the 200 runs in each maze 
group, 

where 

h-moves — the total number of physical moves required by the agent to 
reach the goal under hill-climbing search, 

I II -moves — the total number of physical moves required by the agent to 

reach the goal under Algorithm IH, 

min-moves — the length of the shortest path from 5 to r in the entire maze. 
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Table 3b : Summary of the results for Algorithm III on the 
tree mazes in the first experiment 
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group 

number 


maze 

type 


number 
of mazes 


maze 

density 


grid 

dimension 


avg. number of 
passable cells 


avg, length of 
the shonest paths 


(41) 


non tree 


50 


0.1 


128 X 128 


14735.60 


81.12 


(42) 


nontree 


50 


0.1 


192 X 192 


33498.10 


127.92 


(43) 


nontree 


50 


0.1 


256 X 256 


59854.94 


178.71 


(44) 


non tree 


50 


0.1 


320 X 320 


93825.78 


213.85 


(45) 


non tree 


50 


0.1 


384 X 384 


135424.20 


248.73 


(46) 


nontree 


50 


0.1 


448 X 448 


184573.90 


283.32 


(47) 


nontree 


50 


0.1 


512 X 512 


241348.26 


338.12 


(48) 


nontree 


50 


0.3 


128 X 128 


13135.72 


92.65 


(49) 


nontree 


50 


0.3 


192 X 192 


29874.00 


132.12 


(50) 


nontree 


50 


0.3 


256 X 256 


53392.28 


174.03 


(51) 


nontree 


50 


0.3 


320 X 320 


83700.30 


209.69 


(52) 


nontree 


50 


0.3 


384 X 384 


120756.36 


231.48 


(53) 


nontree 


50 


0.3 


448 X 448 


164621.76 


306.44 


(54) 


non tree 


50 


0.3 


512 X 512 


215232.52 


339.97 


(55) 


nontree 


50 


0.5 


128 X 128 


11825.30 


84.90 


(56) 


nontree 


50 


0.5 


192 X 192 


26873.38 


146.76 


(57) 


noniree 


50 


0.5 


256 X 256 


48046.96 


172.79 


(58) 


nontree 


50 


0.5 


320 X 320 


75301.88 


230.09 


(59) 


nontree 


50 


0.5 


384 X 384 


108664.68 


275.99 


(60) 


nontree 


50 


0.5 


448 X 448 


148092.66 


293.89 


(61) 


nontree 


50 


0.5 


512 X 512 


193664.86 


336.02 


(62) 


nontree 


50 


0.7 


128 X 128 


10476.06 


107.81 


(63) 


non tree 


50 


0.7 


192 X 192 


23821.20 


142.65 


(64) 


non tree 


50 


0.7 


256 X 256 


42604.00 


186.06 


(65) 


nontree 


50 


0.7 


320 X 320 


66786.08 


240.72 


(66) 


nontree 


50 


0.7 


384 X 384 


96425.50 


304.05 


(67) 


nontree 


50 


0.7 


448 X 448 


131414.64 


346.17 


(68) 


nontree 


50 


0.7 


512 X 512 


171841.42 


430.79 


(69) 


nontree 


50 


0.9 


128 X 128 


7800.44 


155.87 


(70) 


nontree 


50 


0.9 


192 X 192 


17865.94 


249.40 


(71) 


nontree 


50 


0.9 


256 X 256 


32196.04 


312.63 


(72) 


nontree 


50 


0.9 


320 X 320 


50536.52 


392.20 


(73) 


non tree 


50 


0.9 


384 X 384 


73132.48 


429.22 


(74) 


nontree 


50 


0.9 


448 X 448 


99938.46 


482.32 


(75) 


nontree 


50 


0.9 


512 X 512 


130727.92 


568.87 



Table 8 : Summary of the 1750 mazes used in the second experiment 
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maze 

group 


Rh 


^/// 


pf = 0 A 0 


pf = 0.45 


p /=0.50 


pf = 0.55 


pf = 0.60 


(41) 


1.222 


1.066 


1.066 


1.066 


1.066 


1.066 


(42) 


1.438 


1.066 


1.066 


1.067 


1.067 


1.067 


(43) 


1.146 


1.070 


1.070 


1.071 


1.071 


1.071 


(44) 


1.077 


1.062 


1.062 


1.062 


1.062 


1.062 


(45) 


1.069 


1.062 


1.062 


1.062 


1.062 


1.062 


(46) 


1.074 


1.064 


1.064 


1.064 


1.064 


1.064 


(47) 


1.081 


1.063 


1.063 


1.063 


1.063 


1.063 


(48) 


1.781 


1.194 


1.194 


1.193 


1.193 


1.194 


(49) 


1.552 


1.200 


1.200 


1.202 


1.202 


1.202 


(50) 


2.367 


1.207 


1.207 


1.210 


1.210 


1.211 


(51) 


2.764 


1.196 


1.196 


1.198 


1.198 


1.199 


(52) 


1.490 


1.208 


1.207 


1.209 


1.209 


1.210 


(53) 


1.406 


1.222 


1.222 


1.223 


1.223 


1.225 • 


(54) 


1.390 


1.188 


1.188 


1.189 


1.189 


1.189 


(55) 


2.995 


1.438 


1.438 


1.423 


1.423 


1.432 


(56) 


5.641 


1.412 


1.414 


1.419 


1.418 


1.416 


(57) 


3.812 


1.500 


1.500 


1.508 


1.508 


1.523 


(58) 


4.624 


1.408 


1.411 


1.411 


1.411 


1.413 


(59) 


11.396 


1.428 


1.429 


1.433 


1.433 


1.436 


(60) 


2.542 


1.444 


1.444 


1.445 


1.446 


1.445 


(61) 


3.067 


1.437 


1.438 


1.435 


1.435 


1.438 


(62) 


10.408 


2.062 


2.087 


2.078 


2.078 


2.100 


(63) 


32.736 


2.123 


2.132 


2.115 


2.117 


2.095 


(64) 


11.397 


1.928 


1.934 


1.927 


1.925 


1.934 


(65) 


36.639 


1.990 


1.983 


1.995 


1.999 


2.015 


(66) 


19.107 


1.996 


2.011 


2.011 


2.014 


2.026 


(67) 


16.616 


2.010 


2.011 


1.975 


1.980 


1.970 


(68) 


32.626 


1.966 


1.958 


1.965 


1.967 


1.963 


(69) 


23.815 


5.131 


5.211 


5.285 


5.293 


5.489 


(70) 


32.713 


5.096 


5.031 


4.918 


5.100 


5.306 


(71) 


53.981 


5.141 


5.231 


5.018 


4.969 


5.216 


(72) 


46.527 


5.751 


5.321 


5.699 


5.800 


5.509 


(73) 


63.471 


5.567 


5.555 


5.408 


5.399 


5.621 


(74) 


67.442 


5.106 


5.275 


5.289 


5.263 


5.095 


(75) 


78.456 


5.668 


5.849 


5.895 


6.069 


5.937 



Table 9 : Summary of the results for Algorithm IE on the 
nontree mazes in the second experiment 
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maze 


p/= 0.40 


p/= 0.45 


p/= 0.50 


p/=035 


/?/= 0.60 


group 


ni<h 


ra=h 


in>h 


llKh 


ffl=h 


Ul>h 


m<h 


m=h 


lD>h 


m<h 


m=h 


m>h 


ni<h 


m=h 


m> 


(41) 


18 


173 


9 


18 


173 


9 


18 


173 


9 


18 


173 


9 


18 


173 


9 


(42) 


31 


152 


17 


31 


152 


17 


31 


152 


17 


31 


152 


17 


31 


152 


n 


(43) 


42 


129 


29 


42 


129 


29 


42 


129 


29 


42 


129 


29 


42 


129 


IS 


(44) 


39 


132 


29 


39 


132 


29 


39 


132 


29 


39 


132 


29 


39 


132 


IS 


(45) 


40 


132 


28 


40 


132 


28 


40 


132 


28 


40 


132 


28 


40 


132 


21 


(46) 


51 


126 


23 


51 


126 


23 


51 


126 


23 


51 


126 


23 


51 


126 


i: 


(47) 


52 


118 


30 


52 


118 


30 


52 


118 


30 


52 


118 


30 


52 


118 


3( 


(48) 


100 


54 


46 


100 


54 


46 


101 


53 


46 


101 


53 


46 


101 


53 


4( 


(49) 


100 


48 


52 


100 


48 


52 


100 


48 


52 


100 


48 


52 


100 


48 


5: 


(50) 


no 


28 


62 


no 


28 


62 


no 


28 


62 


no 


28 


62 


109 


29 


6: 


(51) 


122 


35 


43 


122 


35 


43 


122 


35 


43 


122 


35 


43 


121 


36 


4: 


(52) 


124 


24 


52 


124 


24 


52 


122 


25 


53 


122 


25 


53 


120 


26 


5^ 


(53) 


138 


17 


45 


138 


17 


45 


137 


16 


47 


137 


16 


47 


136 


15 


4< 


(54) 


135 


19 


46 


135 


19 


46 


134 


21 


45 


134 


21 


45 


134 


21 


4: 


(55) 


119 


30 


51 


119 


30 


51 


119 


30 


51 


119 


30 


51 


119 


29 


5: 


(56) 


138 


11 


51 


137 


11 


52 


136 


11 


53 


136 


11 


53 


135 


10 


5: 


(57) 


136 


12 


52 


136 


12 


52 


137 


12 


51 


137 


12 


51 


138 


12 


5( 


(58) 


153 


9 


38 


152 


7 


41 


152 


7 


41 


152 


7 


41 


151 


8 


4 


(59) 


154 


3 


43 


154 


2 


44 


152 


3 


45 


152 


3 


45 


152 


3 


4: 


(60) 


147 


6 


47 


147 


6 


47 


148 


4 


48 


148 


4 


48 


148 


6 


4l 


(61) 


147 


4 


49 


145 


4 


51 


148 


4 


48 


148 


4 


48 


147 


3 


5i 


(62) 


162 


3 


35 


161 


4 


35 


164 


3 


33 


165 


3 


32 


165 


4 


3 


(63) 


148 


6 


46 


146 


6 


48 


147 


7 


46 


147 


7 


46 


147 


6 


4' 


(64) 


152 


1 


47 


152 


1 


47 


150 


2 


48 


150 


2 


48 


150 


2 


41 


(65) 


153 


2 


45 


154 


3 


43 


155 


2 


43 


155 


2 


43 


154 


4 


4: 


(66) 


152 


2 


46 


152 


1 


47 


152 


0 


48 


151 


0 


49 


151 


1 


41 


(67) 


160 


2 


38 


164 


1 


35 


160 


2 


38 


160 


2 


38 


162 


3 


3‘ 


(68) 


174 


0 


26 


174 


1 


25 


171 


0 


29 


171 


0 


29 


171 


0 


2! 


(69) 


132 


8 


60 


133 


8 


59 


128 


8 


64 


130 


8 


62 


129 


10 


6 


(70) 


154 


0 


46 


156 


0 


44 


155 


0 


45 


152 


1 


47 


151 


0 


4! 


(71) 


150 


2 


48 


152 


2 


46 


155 


2 


43 


154 


2 


44 


149 


2 


4' 


(72) 


158 


1 


41 


157 


1 


42 


156 


1 


43 


155 


2 


43 


156 


1 


4: 


(73) 


154 


0 


46 


157 


0 


43 


161 


0 


39 


157 


0 


43 


159 


0 


4 


(74) 


164 


0 


36 


162 


0 


38 


160 


0 


40 


160 


0 


40 


162 


0 


31 


(75) 


155 


1 


44 


151 


1 


48 


150 


1 


49 


150 


1 


49 


151 


1 


41 



Table 10 : Comparisons between Algorithm III and hill-climbing search 
for the nontree mazes in the second experiment 
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maze 


P/ = 


0.40 


P/ = 


0.45 


Pf = 


0.50 


Pf = 


0.55 


pf = 


0.60 


group 


v-exam 


h-op 


v-exam 


h-op 


v-€xam 


h‘Op 


v-exam 


h‘Op 


v~exam 


h-op 


(41) 


1.132 


17.056 


1.135 


17.056 


1.094 


17.056 


1.127 


17.056 


1.130 


17.056 


(42) 


1.146 


19.362 


1.140 


19.362 


1.097 


19.359 


1.134 


19.359 


1.130 


19.358 


(43) 


1.143 


20.990 


1.134 


20.990 


1.097 


20.989 


1.135 


20.989 


1.127 


20.987 


(44) 


1.123 


22.004 


1.112 


22.004 


1.081 


22.004 


1.122 


22.004 


1.110 


22.004 


(45) 


1.127 


22.610 


1.118 


22.610 


1.086 


22.610 


1.129 


22.610 


1.122 


22.608 


(46) 


1.122 


23.432 


1.114 


23.432 


1.084 


23.432 


1.127 


23.432 


1.118 


23.432 


(47) 


1.125 


24.180 


1.112 


24.180 


1.084 


24.181 


1.131 


24.181 


1.118 


24.181 


(48) 


1.389 


14.009 


1.403 


14.009 


1.308 


14.023 


1.371 


14.023 


1.391 


14.023 


(49) 


1.454 


15.349 


1.444 


15.349 


1.367 


15.344 


1.443 


15.344 


1.451 


15.349 


(50) 


1.441 


16.415 


1.426 


16.415 


1.355 


16.416 


1.441 


16.416 


1.445 


16.413 


(51) 


1.391 


17.203 


1.377 


17.204 


1.309 


17.197 


1.394 


17.197 


1.391 


17.192 


(52) 


1.412 


17.823 


1.385 


17.826 


1.318 


17.821 


1.418 


17.821 


1.402 


17.820 


(53) 


1.458 


18.680 


1.440 


18.680 


1.364 


18.682 


1.462 


18.682 


1.467 


18.672 


(54) 


1.367 


19.321 


1.351 


19.321 


1.291 


19.327 


1.386 


19.327 


1.376 


19.324 


(55) 


1.790 


10.165 


1.796 


10.166 


1.672 


10.188 


1.780 


10.188 


1.833 


10.183 


(56) 


1.811 


12.215 


1.805 


12.212 


1.693 


12.214 


1.806 


12.218 


1.801 


12.226 


(57) 


1.902 


12.507 


1.891 


12.517 


1.786 


12.528 


1.913 


12.533 


1.942 


12.535 


(58) 


1.763 


13.635 


1.771 


13.633 


1.641 


13.637 


1.764 


13.637 


1.775 


13.650 


(59) 


1.798 


14.343 


1.766 


14.341 


1.677 


14.328 


1.810 


14.327 


1.811 


14.325 


(60) 


1.853 


14.464 


1.833 


14.468 


1.762 


14.482 


1.899 


14.482 


1.877 


14.476 


(61) 


1.833 


14.810 


1.807 


14.812 


1.716 


14.860 


1.867 


14.860 


1.882 


14.848 


(62) 


2.710 


7.475 


2.817 


7.466 


2.667 


7.504 


2.814 


7.504 


3.024 


7.492 


(63) 


2.797 


8.080 


2.864 


8.079 


2.745 


8.108 


2.891 


8.107 


2.927 


8.166 


(64) 


2.540 


8.992 


2.523 


8.989 


2.447 


9.009 


2.601 


9.017 


2.644 


9.035 


(65) 


2.610 


9.571 


2.597 


9.583 


2.515 


9.587 


2.700 


9.587 


2.810 


9.593 


(66) 


2.625 


10.219 


2.717 


10.203 


2.611 


10.220 


2.779 


10.218 


2.863 


10.212 


(67) 


2.744 


10.239 


2.747 


10.260 


2.555 


10.324 


2.732 


10.316 


2.819 


10.349 


(68) 


2.627 


11.135 


2.588 


11.172 


2.476 


11.203 


2.663 


11.200 


2.740 


11.232 


(69) 


8.163 


3.829 


9.760 


3.843 


10.452 


3.857 


11.030 


3.836 


10.720 


3.858 


(70) 


8.389 


4.442 


8.175 


4.493 


8.563 


4.554 


9.208 


4.551 


9.704 


4.556 


(71) 


10.319 


4.655 


9.844 


4.706 


9.235 


4.749 


9.397 


4.760 


10.196 


4.741 


(72) 


9.711 


4.887 


9.124 


4.943 


10.417 


4.978 


10.919 


5.002 


10.337 


5.074 


(73) 


10.296 


4.979 


10.159 


5.003 


10.356 


5.066 


10.591 


5.101 


11.841 


5.125 


(74) 


9.363 


5.335 


10.528 


5.324 


10.895 


5.382 


11.468 


5.382 


10.284 


5.490 


(75) 


13.050 


5.372 


13.775 


5.397 


14.978 


5.466 


16.762 


5.478 


15.677 


5.526 



Table 1 1 : Average number of vertex examinations and heap exchanges required 
by Algorithm III for the nomree mazes in the second experiment 



Distribution List 



Defense Technical Information Center, 
Cameron Station, 

Alexandria, VA 22304-6145 

Library, Code 0142 
Naval Postgraduate School, 

Monterey, CA 93943 

Center for Naval Analyses, 

4401 Ford Avenue 
Alexandria, VA 22302-0268 

Director of Research Administration, 

Code 012, 

Naval Postgraduate School, 

Monterey, CA 93943 

Professor Robert B. McGhee 
Code CS 

Naval Postgraduate School 
Monterey, California 93943-5100 

Dr. Man-Tak Shing 
Code CS 

Naval Postgraduate School, 

Monterey, California 93943-5100 

LT Michael Mayer, USN 
Software Support Department 
Naval Security Group Activity Skaggs Island 
Sonoma, CA 95476 

Professor Evangelos Milos 
Department of Conq)uter Science 
University of Toronto 
Toronto, Ontario, CANADA 
M5S 1A4 



2 copies 



2 copies 



1 copy 



1 copy 



1 copy 



20 copies 



10 copies 



1 copy 



